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RcqdrMMU 

Hie  Standardised  Position  Oriented  Training  System  (SPOTS)  was  developed  in  response  to  a  Request  for  Personnel 
Research  (RPR  78*20)  submitted  by  the  Air  Force  Manpower  and  Personnel  Center  (AFMPC)  to  the  Air  Force  Human 
Resources  Laboratory  (AFHRL).  The  purpose  of  the  research  and  the  development  of  SPOTS  was  to  provide  a  method 
for  recommending  which  tasks  to  include  in  on-the-job  training  (OJT)  for  specific  jobs  within  Air  Force  enlisted 
specialties.  Recommendations  were  made  in  the  form  of  SPOTS  priority  semes  assigned  to  each  task  for  each  job. 
Although  die  word  “position”  in  SPOTS  implies  an  individual  position,  the  research  effort  used  “job”  as  an  operational 
substitute  for  individual  position,  where  a  job  was  a  statistical  summary  of  the  tasks  performed  by  a  group  of  individuals 
assigned  to  similar  positions.  This  was  necessitated  by  the  fact  that  there  are  several  hundred  thousand  individual 
positions  in  the  Air  Force;  however,  many  of  the  positions  are  similar  enough  that  an  average  job  description  would  be 
suitable  for  them. 


System  Development 

The  development  of  SPOTS  priority  scores  was  based  on  a  judgment  analysis  approach.  The  scores  indicate  the 
OJT  priority  for  each  task  in  each  job  in  an  Air  Force  specialty.  Supervisors  provided  judgments  regarding  the  tasks 
which  required  OJT  for  the  jobs  they  supervised.  Supervisor  judgment  was  the  criterion  against  which  a  mathematical 
model  was  developed.  This  model  was  then  used  to  generate  automated  SPOTS  task  training  requirements  lists  for  each 
job  in  a  specialty.  Four  representative  specialties  differing  in  technicality  (hardware  oriented,  or  not  hardware  oriented) 
and  diversity  (many  jobs  or  few  jobs)  were  used  for  the  study.  The  specialties  selected  were  (a)  423X0  —  Aircraft 
Electrical  Systems  (high  hardware  technicality  and  low  diversity),  (b)  461X0  —  Munitions  Systems  (high  hardware 
technicality  and  high  diversity),  (c)  645X0  —  Inventory  Management  (low  hardware  technicality  and  high  diversity), 
and  (d)  645X0 A — Inventory  Management  Munitions  (low  hardware  technicality  and  low  diversity). 

The  major  result  of  the  study  was  development  of  a  single  SPOTS  mathematical  model  that  could  be  used  in  all 
jobs  across  the  four  specialties.  This  model  included  the  percentage  of  members  in  the  job  performing  the  task  and  the 
task's  learning  difficulty.  Application  of  the  model  resulted  in  a  SPOTS  training  priority  score  for  each  task  in  a  given 
job  within  a  specialty.  The  SPOTS  training  priority  score  was  designed  to  be  used  to  rank-order  tasks  in  a  job  for  OJT 
in  the  order  of  their  training  priority.  Using  the  model,  each  job  in  a  specialty  would  have  a  different  tank-ordered  listing 
of  tasks  for  OJT. 

To  aid  in  using  the  SPOTS  task  listings  and  training  priority  scores,  three  presentation  formats  were  developed: 

(a)  an  automated  SPOTS  listing,  which  arranges  the  tasks  for  each  job  in  descending  order  on  SPOTS  priority  semes, 

(b)  an  automated  version  of  the  Job  Proficiency  Guide  (JPG)  containing  the  SPOTS  training  tasks  listing,  and  (c)  an 
automated  SPOTS  Executive  Summary,  which  displays  the  tasks  occurring  across  all  SPOTS  listings  for  a  specialty. 


Recommendations 

1.  The  Air  Force  Manpower  and  Personnel  Center  (AFMPC)  should  conduct  a  formal  evaluation  of  the  SPOTS 
program  if  and  when  implemented.  The  increase  in  OJT  training  effectiveness  should  be  assessed  by  AFMPC  before 
SPOTS  is  applied  Air  Force  wide,  because  the  SPOTS  program  would  require  additional  manpower  to  support  a  central 
management  office. 

2.  AFHRL  should  incorporate  SPOTS  task  listings  and  priority  scores  in  the  Integrated  Training  System  program 
being  developed  for  AFMPC.  The  SPOT  system  would  provide  the  basis  for  identification  of  tasks  critical  for  training 
for  each  job. 

3.  To  facilitate  operational  implementation  of  the  SPOTS  program,  the  Air  Force  Occupational  Measurement  Center 
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(OMC)  should  (a)  continue  to  collect  task  difficulty  data  as  part  of  its  occupational  analysis  process,  and  (b)  further  refine 
its  job  typing  process.  Presently,  OMC  identifies  jobs  primarily  to  determine  whether  the  Air  Force  occupational  structure 
requires  modification.  Implementation  of  SPOTS  requires  a  fine  detailing  of  the  jobs  in  each  specialty  since  supervisors 
will  select  their  SPOTS  training  listings  from  an  OMC  produced  catalogue  of  jobs  within  these  specialties.  Hence,  OMC 
should  assure  that  supervisors  agree  with  the  job  structure  produced  by  the  occupational  analysis  and  can  identify  jobs 
by  their  OMC  titles. 

The  Air  Training  Command  (ATC)  should  work  closely  with  AFMPC  during  implementation  of  SPOTS  or  its 
derivatives  to  ensure  that  feed-forward  and  feedback  channels  are  instituted  between  ATC  technical  training  and  OJT. 
This  would  benefit  ATC  by  providing  OJT  information  that  would  be  relevant  to  the  development  and  modification  of 
technical  training  school  curricula  and  by  permitting  ATC  to  predict  changes  in  OJT  requirements  based  on  changes 
in  technical  training  school  curricula. 
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STANDARDIZED  POSITION  ORIENTED  TRAINING  SYSTEM  (SPOTS) 


I.  BACKGROUND 

The  dual  channel  on-the-job  training  (OJT)  program  for  Air  Force  enlisted  personnel,  as  outlined  in  Air  Force 
Manual  50-23,  consists  of  a  self-study  Career  Development  Course  and  a  supervised  training  system  conducted  in  the 
actual  work  situation.  The  supervised-training  system  is  discussed  in  this  report. 

In  the  supervised-training  system  within  the  OJT  program,  the  supervisor  selects  the  tasks  each  airman  is  expected 
to  master.  To  this  end,  supervisors  use  the  Specialty  Training  Standard  (STS)  for  their  career  ladder  as  a  guide  in  selecting 
relevant  tasks  to  train.  However,  supervisors  have  voiced  strong  concerns  about  using  the  STS  as  a  guide  for  OJT 
(Stephenson  &  Burkett,  1975)  since  the  STS  is  career  ladder  oriented  rather  than  job  oriented.  As  a  result,  its  items 
are  usually  very  broad  and  are  not  always  specific  to  tasks  actually  performed. 

In  response  to  these  problems  regarding  the  selection  of  tasks  for  OJT,  the  Air  Force  OJT  management  community 
(Greenwell,  Note  1)  developed  the  concept  of  the  Standardized  Position  Oriented  Training  System  (SPOTS).  The  SPOTS 
concept  was  designed  (a)  to  provide  field  supervisors  with  standardized  guidance  for  making  decisions  (by  identifying 
job  tasks  in  the  order  of  their  training  priority),  (b)  to  replace  the  broad,  generalized  statements  of  the  STS  with  a  series 
of  job  specific  task  listings,  and  (c)  to  provide  flexibility  in  OJT  guidance  so  that  local  conditions,  such  as  type  of 
equipment,  major  command  (MAJCOM),  and  manning,  could  be  taken  into  consideration.  Under  the  SPOTS  concept, 
OJT  requirements  would  be  outlined  in  terms  of  the  specific  tasks  associated  with  specific  jobs. 

The  purpose  of  the  SPOTS  research  and  development  program  was  to  develop  automated  procedures  to  produce 
listings  of  tasks  in  order  of  OJT  training  priority  for  each  job  within  a  specialty. 

To  assure  that  the  research  results  would  be  generalizable  to  most  Air  Force  specialties,  four  different  Air  Force 
specialties  were  selected  for  this  study.  They  were  selected  based  on  their  technicality,  i.e.,  in  terms  of  whether 
equipment  is  maintained/operated,  and  on  their  diversity,  i.e.,  in  terms  of  number  of  jobs  within  the  specialty  (high 
=  15  or  more  jobs;  low  =  less  than  15  jobs),  as  reported  in  their  respective  Occupational  Survey  Reports  published 
by  the  Air  Force  Occupational  Measurement  Center  (OMC).  The  specialties  selected  were  (a)  423X0  —  Aircraft  Electrical 
Systems  (high  hardware  technicality  and  low  diversity)  (Gentner  &  Pont,  1979),  (b)  461X0  —  Munitions  Systems  (high 
hardware  technicality  and  high  diversity)  (Jones  &  Street,  1977),  (c)  645X0  —  Inventory  Management  (low  hardware 
technicality  and  high  diversity)  (Nolte  &  Ulrich,  1978),  and  (d)  645X0A  —  Inventory  Management  Munitions  (low 
hardware  technicality  and  low  diversity)  (Nolte  &  Ulrich,  1978). 


II.  FINDINGS 

The  development  of  an  automated  system  for  generating  SPOTS  lists  was  based  on  a  judgment  analysis  approach. 
A  total  of  186  Air  Force  supervisors  in  the  four  selected  specialties  provided  judgments  about  task  training  requirements 
for  58  different  jobs.  They  did  this  by  selecting  tasks  for  inclusion  or  exclusion  for  training  for  jobs  that  they  supervised. 
Although  the  word  “position”  in  SPOTS  implies  an  individual  position,  the  research  effort  used  “job”  as  an  operational 
substitute  for  individual  position,  where  a  job  was  a  statistical  summary  of  the  tasks  performed  by  a  group  of  individuals 
assigned  to  similar  positions.  This  was  necessitated  by  the  fact  that  there  are  several  hundred  thousand  individual 
positions  in  the  Air  Force;  however,  many  of  the  positions  are  similar  enough  that  an  average  job  description  would  be 
suitable  for  them.  Supervisors  made  their  judgments  regarding  task  training  requirements  on  forms  that  listed  tasks  in 
an  a  priori  estimated  order  of  training  importance,  but  with  no  data  explicitly  shown. 

Two  different  levels  of  judgment  analysis  were  completed  to  develop  mathematical  models  of  the  supervisors’  task¬ 
training  requirements  decisions.  The  first  level  analyzed  separate  models  for  each  of  the  58  jobs.  A  comparison  was 
made  between  the  resulting  models  for  jobs  within  each  specialty,  and  within  each  specialty  there  was  sufficient  similarity 
to  allow  a  broader  specialty  model  to  be  used.  The  second  level  analyzed  separate  models  for  each  of  the  four  specialties. 
The  specialty  models  were  found  to  be  similar  enough  to  permit  the  use  of  a  single  Air  Force  SPOTS  mathematical  model. 
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Further  analyses  of  the  models  indicated  that  two  main  factors  (i.e.,  the  multiplicative  interaction  between  the 
percentage  of  members  in  the  job  performing  the  task  and  the  task’s  difficulty,  combined  with  the  percentage  of  members 
in  the  job  performing  the  task)  consistently  received  heavy  weights  by  the  supervisors  when  they  recommended  tasks 
for  OJT  requirements.  Thus,  if  the  percentage  of  members  in  the  job  performing  the  task  and  the  task’s  difficulty  were 
known,  a  fairly  good  estimate  could  be  made  as  to  whether  a  supervisor  would  recommend  training  on  the  task  for  that 
job.  Table  1  shows  the  equation  used  to  compute  OJT  priority  scores  by  employing  the  regression  weights  with  the 
corresponding  values  for  the  two  variables  and  using  a  constant  factor.  This  equation  produces  an  OJT  priority  score 
for  each  task  defined  within  a  job.  It  should  be  noted  that  Task  Difficulty  ranges  from  1  to  9,  with  a  mean  of  5  and  a 
standard  deviation  equal  to  1.  Table  2  shows  the  input  data  and  resulting  SPOTS  scores. 


Table  1.  SPOTS  Model  to  Predict  OJT  Priority 


Variable 

Raw  Score 
Regression  Weights 

A.  Percentage  of  Members  in  the  Job  Performing 

Task  by  Task  Difficulty  (A) 

.002742 

B.  Percentage  of  Members  in  the 

Job  Performing  Task  (B) 

-  .005797 

C.  Constant 

-.019506 

Note.  SPOTS  Score  =  (.002742  x  A)  -  (.005797  x  B)  -  .019506 
R  =  .620635 
R2  =  .385188 


Table  2.  Summary  of  SPOTS  Model  Input  and  Output  Data 


_ Range _ 

Variable  Mean  SD  Minimum  Maximum 


A.  Percentage  of  Members  in  the  Job 


Performing  Task  by  Task  Difficulty  (A) 

50.6 

90.6 

0.000 

730.000 

B.  Percentage  of  Members  in  the  Job 

Performing  Task  (B) 

10.8 

19.3 

0.000 

100.000 

C.  SPOTS  Score 

.057* 

... 

—  0.020b 

1.402b 

*  The  SPOTS  score  shown  w«*  calculated  by  applying  raw  regression  weights  from  Table  1  to  the  Mean  values  of  the  A  and 
B  predictors. 

b  The  range  of  SPOTS  scores  shown,  calculated  from  the  range  extreme  values  of  the  (A)  and  (B)  predictors,  exceeds  the  SPOTS 
score  theoretical  range  of  0  to  1 . 


HI.  CONCLUSIONS 

The  purpose  of  the  SPOTS  research  and  development  program  was  to  develop  methods  for  automating  listings  of 
tasks  in  the  order  of  training  priority  for  Air  Force  jobs.  This  goal  has  been  accomplished  in  that  a  single  automated 
mathematical  model  was  developed  that  could  rank  order  job  tasks  for  OJT.  The  model  was  found  to  be  appropriate  for 
the  specialties  included  in  the  study  and  is  presumed  to  be  applicable  for  all  Air  Force  specialties  that  have  been  analyzed 
by  OMC.  However,  further  research  would  be  required  to  test  this  presumption.  An  important  finding  is  that,  across 
all  jobs,  supervisors  tend  to  place  the  most  emphasis  on  the  same  factors  when  selecting  task  for  OJT.  These  factors 


are  (a)  the  interaction  between  the  percentage  of  members  in  the  job  performing  the  task  by  the  task’s  difficulty  and 
(b)  the  percentage  of  members  in  the  job  performing  the  task.  Both  factors  are  routinely  collected  by  OMC  in  the 
operational  Occupational  Survey  Program.  Thus,  application  of  SPOTS  to  all  analyzed  specialties  is  highly  feasible. 

The  procedure  for  generating  the  SPOTS  listings  for  any  enlisted  specialty  is  planned  for  publication  in  a  future 
AFHRL  technical  paper.  The  procedure  is  specifically  designed  for  implementation  by  OMC  personnel.  This  is 
appropriate  since  OMC  has  access  to  the  data  base  required  to  generate  the  SPOTS  listings  through  the  on-line 
Comprehensive  Occupational  Data  Analysis  Programs  (CODAP)  system  shared  with  AFHRL  on  the  AFHRL  UNIVAC 
system. 

To  aid  in  using  the  information  developed  in  SPOTS  research  and  development,  three  different  presentation  formats 
for  the  SPOTS  task  listings  and  priority  scores  were  designed.  These  formats  were  (a)  an  automated  SPOTS  listing,  which 
arranges  the  tasks  in  descending  order  based  on  the  SPOTS  priority  score  for  a  specific  job  (Figure  A-l),  (b)  ap  automated 
version  of  the  Job  Proficiency  Guide  (JPG)  containing  the  tasks  listed  in  the  SPOTS  listing  (Figure  A-2),  and  (c)  an 
automated  SPOTS  Executive  Summary,  which  displays  the  tasks  occurring  across  all  SPOTS  listings  for  a  single  specialty 
(Figure  A-3).  All  of  these  products  provide  definitive  information  to  the  supervisors  and  executive  managers  in  the  field 
on  the  OJT  priority  of  the  tasks  in  a  specialty. 

IV.  APPLICATIONS 

The  SPOTS  program,  if  implemented,  would  affect  the  Air  Force  in  at  least  five  areas.  First  and  foremost,  it  would 
enhance  OJT  by  enabling  supervisors  to  select  tasks  for  training  that  are  job  specific,  a  capability  that  is  not  currently 
widespread;  task  selection  would  be  relatively  straightforward  since  the  SPOTS  listing  would  be  prescriptive. 
Second,  it  would  increase  mission  capability;  given  that  OJT  would  be  targeted  to  important  tasks,  airmen  would  be 
trained  on  those  tasks  actually  required  for  mission  effectiveness.  Third,  it  could  affect  the  Air  Training  Command  (ATC) 
technical  training  courses;  the  SPOTS  task  listings  could  be  used  to  justify  increased  training  on  important  and  widely 
performed  tasks,  or  the  listings  could  lead  technical  trainers  to  provide  less  training  on  tasks  that  would  have  high 
probability  of  being  trained  in  the  field  by  OJT  supervisors.  Fourth,  it  could  affect  the  Air  Force  classification  structure; 
the  identification  of  training  tasks  by  SPOTS  provides  a  common  measure  in  identifying  or  redefining  jobs  or  specialties. 
Fifth,  it  could  affect  the  Air  Force  assignment  system;  identification  of  important  tasks  which  fulfill  training  and 
proficiency  requirements  of  each  job  could  aid  in  selection,  assignment,  and  career  development  based  upon  the 
requirements  of  jobs  and  the  experience  of  the  individuals. 

V.  RECOMMENDATIONS 

1.  The  Air  Force  Manpower  and  Personnel  Center  (AFMPC)  should  conduct  a  formal  evaluation  of  the  SPOTS 
program  if  and  when  implemented.  Since  the  SPOTS  program  would  require  additional  manpower  to  support  a  central 
management  office,  the  increase  in  OJT  training  effectiveness  should  be  assessed  by  AFMPC  before  SPOTS  is  applied 
Air  Force  wide. 

2.  AFHRL  should  incorporate  SPOTS  task  listings  and  priority  scores  in  the  Integrated  Training  System  program 
that  is  now  being  developed  for  AFMPC.  The  SPOTS  program  would  provide  the  basis  for  identification  of  tasks  critical 
for  training  for  each  job. 

3.  To  facilitate  operational  implementation  of  the  SPOTS  program,  OMC  should  (a)  continue  to  collect  task  difficulty 
data  as  part  of  its  occupational  analysis  process  and  (b)  further  refine  its  job-typing  process.  Presently,  OMC  identifies 
jobs  primarily  to  determine  whether  the  Air  Force  occupational  structure  requires  modification.  Implementation  of  SPOTS 
requires  a  fine  detailing  of  the  jobs  in  each  specialty  since  supervisors  will  select  their  SPOTS  training  listings  from 
an  OMC-produced  catalogue  of  jobs  within  these  specialties.  Hence,  OMC  should  ensure  that  supervisors  agree  with 
the  job  structure  produced  by  the  occupational  analysis  and  can  identify  jobs  by  their  OMC  titles. 

4.  The  Air  Training  Command  (ATC)  should  work  closely  with  AFMPC  during  implementation  of  SPOTS  or  its 
derivatives  to  ensure  that  feed-forward  and  feedback  channels  are  instituted  between  ATC  technical  training  and  OJT. 


This  would  benefit  ATC  by  providing  OJT  information  that  would  be  relevant  to  the  development  and  modification  of 
technical  training  school  curricula  and  by  permitting  ATC  to  predict  changes  in  OJT  requirements  based  on  changes 
in  technical  training  school  curricula. 
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